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ABSTRACT 


In this paper, we examine one of the fundamental assumptions of behaviour-based models: that 
complex functionalities can be adiicvcd by decomposition into simpler behaviours. In particular 
we look at the issue of conflicts among robot behaviour modules. The chief contribution of this 
work is a formhl characterization of temporal cycles in behaviour systems and the development of 
an algorithm for detecting and avoiding such conflicts. We develop the meclianisms of stimulus 
specialization and response generalization for eliminating conflicts. Thus the probable conflicts 
can be detected and eliminated before implementation. However the process of cycle elimination 
weakens the behaviomr structure. We show how (a) removing conflicts r«ults in less flexible amd 
less useful behaviour modules and (b) the probability of conflict is greater for more powerful be- 
haviour systems. We investigate several other behaviour representations and show that these are 
also susceptible to cyclic conflicts since conflicts occurring at knowledge level cannot be solved at 
the representation level. We conclude that purely reactive systems are limited by cyclic behaviours 
in the complexity of tasks they can perform. Possible solutions involve hybrid systems with inter- 
nal state that can mediate conflicts, and possibly, a capacity for letirning or sclf-modilication. 
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into a problem solving system; whatever systems have been iinplcincntc<J have bam done by liuinaii 

i 

programmers. In particular, one must look at the mechanisms for combining behaviours, what 
Brooks calls “controlled amalgamation” [19]. Also the lack of a representation prevents the 
system from doing tasks that require knowledge that cannot be obtained through perception - such 
as analogous examples, or other tasks involving creativity. Mataric has observed that subsumption 
architecture and fully reactive systems have been limited to applications requiring no explicit 
internal representation, which imposed a fundamental limitation on the domain of applications 
for the architecture [40]. . Hartley Sc Pipitone seem to think that the subsumption arciiitecture 
as currently defined is not sufficiently modular and it is not always clear if a strict hierarchy of 
behaviours is appropriate [27]. Payton [46] argues that information is invariably lost when it is 
hidden within behaviour modules or contained in commands which are subsumed. Later in this 
paper, in Chapter 5, we discuss the relation between reactive behaviours and planning - whether, 
as some suspect, the evils of planning (cycles, interdependent goals) may also arise in reactive 
ardiitectures [24]. 

One of the problems with modular designs (databases, eurchitectures, factories) is that of con- 
flicting functionalities between modules. Such inter-modular conflict often arises due to resource- 
sharing type of problems, which can often be resolved by temporally sequencing the behaviours in 
a certain manner. This is adjieved in traditional behaviour systenas by auppresaing one behaviour 
by another. In most implementations, control of behaviours has been done in an ad hoc manner, 
with suppressive links being added whenever it suited the primary objective of demonstrating suc- 
cess in the current task objectives. Brooks [13] stresses that additional layers can be added later, 
and the initial working system need never be diangcd - our results show that such a claim is most 
probably not tenable. The number of behaviours possible from a given set of behaviours combina- 
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torially explodes if spatial and temporal ordering is allowed [1]. Then how does one order or search 
this space? The more basic question raised by this is: How does one put the behaviour modules 
together and get useful performance? A related issue is extending or editing behaviour systems: 
the question that this raises is the issue of compatibility between the new and the pre-existing be- 
haviour modules. All these questions depend on identifying the possible sources of inter- modular 
conflicts that are likely to arise in behaviour chains. 

This paper is one of the first formal investigations on the issue of combining behaviours and 
inter-behaviour conflicts. Despite the large scale attention such models have been receiving, the 
issue of interbehaviour conflict, which challenges the fundamental assumption of behaviour mod- 
ularity, has not received sufficient attention. A typical scenario is one where the consequence of 
a behaviour A triggers the stimulus for behaviour B which precedes A, resulting in an unending 
cycle. Connell [18] too has reported that without a history of events or an overall picture of the 
situation, the robot faces the possibility of getting stuck in local minima or entering infinite loops 
instead of achieving its true goal. Such conflicts are also beginning to show up in the more complex 
behaviour implementations. For example, Connell [18] records an instance where a can collecting 
robot attempts to re-pick the can it has just deposited in the destination area as shown (Figure 
1). This conflict was not detected until after a full implementation. Cyclic conflict of going back 
and forth between two obstacles has been reported [42]. Cyclical wandering has been reported by 
Anderson & Donath [1]. Cycle has been reported in the task of co-operating robots pushing a box 
[33]. Can behaviour systems be constructed so that such conflicts can be detected beforehand? 
Can one construct an algorithm for modifying behaviours so as to avoid sudi conflicts? These are 
some of the questions we set out to answer. 

Behaviour systems have also been moving away from the purely reactive paradigm. A well- 
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known cxlcnsion of tlie Brooks’ approach includes llic SONAR MAP [9] whicli is a module lital 
learns what looks suspiciously like a central representation. Chatila [17] points out that sooner or 
later in the evolution of this system, the ability to plan actions and execute them (and not only 
to react to external stimuli) will have to be incorporated to achieve increased autonomy. Connell 
[18] concludes that relaxing the temporal locality condition, the robot’s navigational skills could 
be significantly augmented with the addition of a relatively small amount of persistent state. Gat 
[24] points out that the solution is not to eschew the internal state, but to use it only for modeling 
information at high levels of abstraction. 

Our analysis in this paper is dependent on a crucial observation regarding the temporal struc- 
ture of purely reactive systems. Control parallelism as in the subsumption arcliitectiire is different 
from temporal parallelism. The conflicts we are addressing are not control conflicts but tem- 
poral sequence conflicts. In order to investigate such conflicts, it is necessary to separate the 
control structures of behaviours, from their temporal structures. While the control structure is 
essentially parallel, the temporal structure of behaviours is mostly sequential. In practice, one be- 
haviour usually provides the stimulus for another, so that there is often a clear temporal sequence 
iU' which behaviours are executed. Thus behaviours may be thought of as occurring in tempo- 
ral sequences. We model these by a sequentiality operator, and call such sequences behaviour 
chains. These are not to be confused with the control model, which remains largely parallel. 



Figure 1. Conflict in picking and placing the can. 
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Arbitration type of conflicts have been envisaged in behaviour systems from the very start. The 
most common mechanism for dealing with these control conflicts is subsumption [9], which is in 
essence a prioritization scheme between behaviours that are likely to be triggered siinultaiieously. 
However, prioritization methods are inadequate for resolving cyclic conflicts, since the cycle may 
reappear whenever the suppressing behaviour has completed its execution. In this paper we show 
that such cycles can be avoided only by modifying the behaviours themselves, and we introduce 
two such modifleations, based on specializing the stimulus or restricting the action of a behaviour. 
One of the key results of the paper is that any such inodifleation reduces the usefulness of the 
behaviour structure and makes it less flexible. 

Next we describe the models of behaviour and our notation for behaviours in Chapter 2. In 
subsequent chapters we deal with the detection of cycles in behaviour chains, and our strategy 
of behaviour refinement for eliminating the conflicts. Similarities between AI planning and the 
behaviour based approadi are discussed in Chapter 5. Chapter 6 discusses alternate architec- 
tures for robot control and role of learning and behaviour modification. Chapter 7 presents our 


conclusions. 
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Chapter 2. What Is a Behaviour? 

AI researchers, psychologists, cognitive scientists, ethologists and roboticists all use the term 
behaviour in senses that are related but are fundamentally different. 

At one end of the spectrum is Brooks [9] who looks upon behaviours as a type of intelligent 
module, an input-output relation to solve small problems. Hopefully these can be combined to 
solve larger problems. Each behaviour is affected by and affects only the external world, except 
for the inhibition and auppi'easion control signals which disable the output from other behaviour. 
Brooks reports that inhibition and suppression are the mechanisms by which conflict resolution 
between actuator commands from different layers is achieved [12]. Conflict resolution tends to 
happen more at the motor command level, rather than the sensor or perception level [11]. But 
this is true for resource sharing type of conflicts and does not hold for cyclic conflicts. There is 
no other form of communication between modules, in particular there is no shared global memory. 
The stimulus to a behaviour is boolean, and is tested by an applicability predicate. A transfer 
function defines what output to generate for the given input. This is the model of behaviour 
investigated in this paper. 

Minsky [43] suggests thinking about goal directed behavioiir as an output of a difference engine 
that measures the differences between the world state and the goal state and then takes actions 
to reduce these differences. This sounds like planning. On the other hand, Simon [48] feels that 
complex behaviour need not necessarily be a product of an extremely complex system, rather, 
complex behaviour may simply be the reflection of a complex environment. Ethologists like Gould 
emphasize the importance of motivation in addition to sensors and effectors [26]. 

A number of reactive models have been used in robot navigation tasks. The well known model 
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by Arkin proposes motor schema as a basic unit of behaviour specification for the navigation of a 
mobile robot [2]. Motor schemas like move-ahead, avoicLstatic-obstacle, move-to-goal are used 
for robot navigation. Potential fields arc used to guide operation of the schemas and there b a 
notion of stimulus strength in such models. However, many such models are not purely reactive 
since a priori world knowledge may be used to guide the selection of the schemas that are nec- 
essary for successful completion of the robot’s mission. A schema is a model used in psychology 
to describe the interaction between perception and action and can be adapted to yield a mobile 
robot system that is highly sensitive. The word schema is linked with the motor program model 
used in psychology which stores muscle command sequences for executing complex actions quickly; 
a schema permits such motions to have some parameters as well, the precise relationship being 
learned over time in human subjects [47]. 

2.1 Notation 

Models of behaviour vary widely between robotics, psychology, cognitive science. Maes [39] models 
a behaviour module as a .^-tupfe <c, a, d, a> which represent pre-condition, add list, delete list 
and activation level. In this work we have followed the behaviourists and adopted a S- tuple model 
of behaviour: stimulus, action, consequence. ^ 

An elemental behaviom module jS takes the form <s, a, c>. Both s and c are commonly 

/ 

defined in terms of a logical expression. A response is an action, which results in certain changes 
in the self-state of the robot or in the state of the environment. In our strategy of detection and 
elimination of conflicts, action is not directly useful, thus we prefer to drop it in examples here 

though' it remains an important part of our notation. 

^Psychologist Blackxnan [8] uses the notation A : B : C, for behaviour where A = antecedent or setting conditions, B — 
behaviour, C = consequence. 
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Much of our analysis studies the temporal relations between behaviours. For this purpose we 
define the dominant period of a behaviour as that period when the behaviour is active. This term 
is analogous to the duration of an event. In most behaviour implementations, behaviours become 
dominant in a temporal sequence. We use the symbol to denote this, i.e., : 02 says that 

behaviour 02 becomes dominant following behaviour / 3 i* It is read as “precedes”: the module 0i 
precedes the module 02 if and only if there exist time instants 9i, 02) ^3i 0% <02 < 0z such that at 
01) 01 is dominant but 02 is not and at 02, 0i and 02 are both active or they meet and at 03, 02 is 
active but 0\ is not. The temporal chain of behaviours C =) {0i : 02 : 03 : ... : } is an ordered 

set where the ordering is based on temporal precedence as defined here. The temporal analysis 
performed here may be thought of as a posteriori, i.e. afto- the behaviours have been designed, 
or even after it has executed. However, in practice, it appears that most behaviour designers have 
in mind a certain task, and this can be performed typically by executing behaviours in a certain 
sequence, so much of the analysis also applies to behaviour design itself. 

2.2 Behaviour Chain 

We define a behaviour chain as a sequence of behaviour modules {0i ’.02 • 03 - — : A»} where each 
module except the first one follows from the earlier one in the chain. Here the action of the earlier 
module changes the situation in such a way that the newly changed part of the situation is in turn a 
stimulus for the next module in the sequence. If the consequence and stimulus include a finite uni- 
versal state as well, then we can say that the stimulus of the behaviour module 0i+i is logically 

implied by the consequence of the module 0i i.e. (cj =» Si+i). Also no other module of higher pri- 
ority should have a suppressive effect on 0i+i. Consider, for example the behaviour explore which 
can be defined in terms of lower level behaviours go-to-new-loc that enables the robot to go to 
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the location of a new object and go-around that enables the robot to go around the object to And 
its extents. Our deAnition of the behaviour explore is, explore := {goJbo-newJloc : go-round) 
goJto-newJLoc : = < notvisited(x) ^ loc(x,L), consequence.of-goJ:o.newJoc-acticm > 
go^ound : = < newloc{L) ^ atsafedist{L), consequence-of-go-around-action >. 

This discussion does not handle concurrent execution of behaviours. Consider for example, 
the task of Ailing bottles in which the filLbottle module holds the bottle below the tap and 
check-level checks the level of Auid in the bottle while the bottle is being Ailed. Such behaviours 
will be “forked” off the chain at some point and will “re-enter” at some other point. The temporal 
sequences between behaviours in the parallel branches in this case are unclear. Our model can 
be extended to this case. However, one could decompose concurrent behaviours into individual 
behaviour diains, e.g. { /3] : ; . . . ; • A • • • • • A ■ A •'••••' Ai } as well as { jSj ; A 

• ■ • /Sm A • • • •• A> A • • • •■ Ai } (Figure 2). 

We deAne a behaviour apace H as a set of behaviour modules. A temporal chain of behaviours 
Cissaid to be composable from Bif and only if ( C=onieredset {A} AC®^*)A € B). Weexpress 
this by C -< B, read as C is composable from B. A stimulus space S of a behaviour space B is 
the union of all the stimuli of all behaviour modules in B. 



Figure 2. Behaviour chain with concurrent behaviours 


In a befraviour A with action Ot, the consequence q is the set of predicates affected by the action. 
e.g. conseq (pickup-action) is ( handholds(x) /\ can{x)). As a consequence of action of a mod- 
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ule, some new predicates become true and some old predicates become false. This is similar to the 
add and delete lists in STRIPS [22] (see Section S). 

2.3 iVame Problem 

This model is subject to the frame problem i.c. considerations of universal trutlis [25] [28]. In 
our context, behaviour module /3j leads to ^ when (ci 32 ). But here we need to consider the 
universal truths also. Let Universe — X f\Y f\Z and ci = A and S 2 = X ^ A. Then 
leads to P 2 but (ci ^ Thus when we say that (ci ^ 32 ) we mean that a part of 32 was true 
earlier and some literals in Ci cause the rest of 52 to come true. Thus : /32 is not equivalent to 
(ci =► S 2 ). Some psychologists [36] have modeled this universe as the “situation” , r^ulting in the 
S-tuple (stimulus, situation, response). It is well established that the stimuli required to activate 
a complex behaviour pattern are usually only a very small subset of the total amount of sensory 
information available to the animal, known as sign stimuli. The distinction between situation and 
stimulus is quite unclear in the behaviour models. Also if atuation is the same as universe, then it 
may not be finite. In our model, limiting our analysis to a small set of behaviours, we temporarily 
overcome this objection by considering a finite behaviour space, where the stimuli and the con- 
sequences are enhanced by all universal trutlis that are affected in any individual behaviour of a 

chain. While we realize that this definition is different in its implementation from that typically 
/ 

used in reactive behaviour systems, we adopt it since it does not cause any fundamental changes 
within the behaviour chain, and it allows us to develop the argument skirting the philosophical 


problems. 
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2.4 Power, Usefulness and Flexibility of Behaviours 

In order to compare different behaviour systems, it is necessary to have some measures of what can 
be achieved by these systems. Here we define a few relative measures for comparing behaviours. 

Definition 1 
• Power : 

A behaviour (/3 := <s, a, c>) is more powerful than {fi' := <$', a', c!>) iff (s' 3) /\ (c d ) 

Using the convention that predicate pi is stronger than predicate p2 if (pi P2), we can say that 
a behaviour is more powerful if its stimulus is weaker and its consequence is stronger. In other 
words, it can be triggered at least as frequently as a less powerful behaviour and results in at least 
as strong a consequence. For example, a general behaviour pick-up that can pick up any object 
is more powerful than pick-up-coffee-cup, since the stimulxis for the latter is stronger, but the 
consequences remain the same. A behaviour space B is more powerful than the behaviour space 
B' if B' can be obtained from B by replacing some module P sBhy less powerful module /?'. Thus 
the term “powerful” can apply to both Individual behaviours and an entire behaviour space, but 
we trust this overloading will not be confusing. 

I • Usefulness : 

A set of behaviours is more useful if it can perform more tasks. A behaviour space B spans the 
task space r if and only if { V € rj ( 3 ( C-< B) fulfills ( C,t)) }. The greatest fulfillable task 

t 

space Ta (B) is the largest task space that is spanned by the behaviour space B. The usefulness 
of a behaviour space is defined as the ratio . Thus, a behaviour space is more useful if 

its cardinality is lower (it has fewer behaviours), but it can fulfill as many tasks as some other 
behaviour space with more behaviour modules. 
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• Flexibility: 

A behaviour space B is at least as flexible as behaviour space B' if {'it £ {tq (B) n tq {B')), 3 (C -< 
B) I { fulfills iC,t) A V(C' B'){ fulfills In other words, any chain 
composable from B' is at least as long as a comparable chain in B that performs the same task. 
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Chapter 3. Detection of Conflicts 

Any behaviour chain leading to non-fulfillment of the desired objectives can be said to have a 
conflict. Let a chain C = {/3i : /32 : : At} be the desirable behaviour sequence that achieves a 
desirable outcome. There are three types of conflicts that can cause the chain C from not being 
executed, by breaking the sequence A : A+i* 

Deflxution 2 

(a) £xtraneous behaviour Conflict : A : 0'> P' ^ C, an extraneous behaviour 0 is triggered 
by A, this can lead to irrelevant consequences that are undesirable. This type of conflict can often 
be forseen by the designer and controlled by suppressive link. (Mcfarland [41] definps conflict as 
a state of motivation in which tendencies to perform more than one activity are simultaneously 
expressed. We find similarity between this definition and our definition of extraneous behaviour 
conflict.) 

(b) Cyclic Conflict: A : jSfci Pk € C, k < i, this is a cyclic conflict, discussed in detail later in 
this chapter. 

(c) Skipping Conflict : A • Pk, Pk ^ C, k > (i + 1), this is a skipping conflict and may 

1 

not achieve the full task. Such a situation causes many of the intermcriiate behaviours to be 
skipped. Thus some of the stimuli required for the behaviours /3fc+i> Pk-i -2 etc. may not have 
become available. This type of conflict can be treated in a manner analogous to extraneous be- 
haviour conflicts. The type of behaviour that we are investigating is the cyclic conflict, where, 
both A+i and Pt may be triggered and clearly the triggering of Pk would lead to a cycle (Figure 
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Figure 3. Cyclic conflict in a temporal chain of behaviours. 

3). 

3.1 Terminated Cycles 

All cycles need not result in a conflict. Let us say that we have a large block of butter that needs 
to be cut into a number of smaller pieces. A module cut achieves it. Cut gets activated when a 
block of butter is visible and is cuttable by the robot and its action is the division of the piece of 
butter into two halves. The cycle of cutting the successive sinalier pieces of butter, is indirectly 
implementing a recursive behaviour. We specify the smallest acceptable size of the piece of butter 
by specifying the limit A, which introduces the termination condition (Figure 4). The behaviour 
cut has a cycle in it, but this is not a conflict situation since there is a termination condition 
with the characteristic that after a finite number of cycles, the consequence of the behaviour itself 
causes its stimulus to become false. Terminated cycles may also involve more than one beliaviour; 
here the chain contains a loop but the consequence of the last behaviour ch in the chain eventually 
ca'uses the stimulus of the first si to become false. All such terminated cycles can be detected by 
a test to see If some literal 7 common to Cn and Si, or its parameters, are changing at the end of 
^ach cycle such that eventually 7 becomes false in Cn, thus negating the implication. As soon as 
a cycle is detected in a behaviour chain, the literals in 0, the most general substring between c„, 
3 i are checked. Typically, the parameters involved in the predicate (like b and A above) should 
be investigated to see if this is the case. A more powerful termination detection can be performed 
if the predicates are not boolean but have a strength of stimulus characteristic, in which case a 
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reducing strength is indicative of possible termination. 


Figure 4. Termination condition in a recursive cycle. (b>2X) is the termination condition. 

3.2 Prioritization 

We consider the role of suppression, inhibition and delayed action in conflict resolution. If a : /3 
is a possible but undesirable behaviour s(X|ucn(x, these are the inechanisiris to modify it. Unfor- 
tunately, there does not appear to be a cletir dehnition of these terms in the behaviour literature. 
For our purposes, we consider four cases : 

(1) Simple temporal sequence : This is a: (3, whidi means that behaviour module a precedes the 
module /3. 

(2) Suppression : Consider a : such that the output of S is suppressed by 7 . After a has exe- 
cuted, stimuli for both 13 and 7 are available. The action of jd does not take place. Then the chain 
« : /3 is broken and a : 7 occurs. 

(3) Inhibition : Consider a : S such that the output of is inhibited by the output of 7 . In this 

case the action of (3 takes place, but only after 7 is no more dominant. Here the chain a : S has 

/ 

the module 7 inserted, so we have a : 7 : ^9. This assumes that the consequence of 7 does not 
destroy the stimulus for /3. Inhibitive links temporarily forbid the robot from attempting a certain 
operation without disturbing the rest of its control system, e.g. if the. robot notices a new spot 
while' wandering, then the output of wander is inhibited by the output of module from explore 
level, thus after the spot has been explored, wandering will again continue. 


(visihle(x) f\ butter(x) l\ euttable(x) 
^rectangle(x) breadth (x,h) f\(b>2X)) 
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(4i)Delayed action: This is a special case of inhibition, where the inhibitive link remains effective 
for some time t^eiay even after the inhibitive module is no longer dominant. Connell [18] uses the 
term retriggerable monostable to capture this sense. If a : /3 : 5 is the chain in which the output 
of )3 is inhibited by 7 , then after a, 7 executes and remains dominant for tjeiay after its stimulus s^ 
is no longer available, then if stimulus for ^ is still available, /3 executes else 6 executes. This action 
causes the subsequent behaviour to be delayed. This is similar to Skinner’s law of after-discharge 
which states that the response may persist for some time even after the stimulus has vanished. 

These three measures establish the relative priority between behaviour modules. In practice, 
behaviour system designers use them to obtain a desirable behaviour chain that meets the current 
task objectives. Thus the reasoning leading to these prioritization lies at the motivation level and 
not at the reactive level. This is clearly a metarlevel proce^, and some form of global knowledge 
representation will be needed in order to reason about these links from within the behaviour 
system. While it is possible to detect conflicts, installing priorities in purely reactive systems 
therefore remains a prerogative of the designer. In the can example, had the behavioinr system 
used the context i.e. the fact that the can was not to be picked up, the can would not have 
been picked. This challenges the assumption of locality of knowledge which claims that currently 
obtained knowledge about the world through perception is sufficient for doing tasks. 

What type of conflicts can be avoided by prioritization? Clearly, extraneous behaviour and 

/ 

skipping type of conflict can be avoided. If the robot has behaviours grab-book and grab-can 
and it simultaneously sees both of them, then that conflict is of extraneous behaviour type if the 
robot has only one gripper. This too can be solved by adding a suppressive link. However cyclic 
conflicts Pi : pki k < i cannot be reliably eliminated by these prioritization schemes. Inhibition 
cannot eliminate <grclic conflicts since the offending module is executed immediately following 
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the inhibiting module. Tliere can be very few cyclic conflicts whicli can be resolved permanently 
by retriggerable monostable. This is similar to behavioural hysterisis discussed by Beer et al [7] 
where the edge following behaviour of an insect persists for a short period of time even after the 
sensory stimulus which initially triggered has been removed. As another example of the effect of 
delay, consider a module move-cradle that is triggered when the robot detects the cry of a child, 
move-cradle : = < (cries {x) child{x) /\ incradle{x)),con3equence.ofjmove-cradle.jaction > . 

After the child cries in the cradle, robot starts moving it and child stops crying. Since the 
stimulus has vanished, the robot no more moves the cradle. But as the motion of the cradle has 
stopped, the child starts crying again (Figure 5). The robot again starts moving the cradle. But 
had the robot moved the cradle for a little more time even after the child had stopped crying for the 
first time, i.e had the behaviour module move-cradle remeuned active for a longer time, say upto 
ta even after the stimulus of cry of the diild had vanished, the child would have stopped crying and 
cycles would have been avoided. This can be achieved by a retriggerable monostable. However, 
note that the length of the delay, the type of behaviour where this will work, the probability of 
achieving success are all not predictable here. For this to work, it requires that the behaviour that 
is delayed has a higher priority over the behaviour which leads to cycles. Moreover, during the 
delay period, it assumes that some intervening action (e.g. wander) causes the stimulus leading 

to the cycle to vanish. The delayed action scheme assumes the existence of some intermediate 

/ 

behaviour such that the consequence of invalidates the stimulus of (in Connell [18], this 
pi is available in the form of wander which is likely to make the dropped can temporarily invisi- 
ble); but Pk may still be triggered after time tdeiay This is clearly an ad-hoc measure and cannot 
be guaranteed to work. Even Brooks in some early implementations, \ises time lags along with 
the inhibition signal, but these were not used in the later models. 
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(criea(x) /\ child(x) incradle(x)) 

I 


move-cradle 




Jc. 

Ca 


c„ 


Figure 5. A conflict that can be prevented by retriggerable monostable 


Suppressive links are not guaranteed to kill the stimulus of I3k, hence /S* may be active after 
dominant period of the suppressing module is over. 

Thus within the scope of the three prioritization schemes discussed here, it is not possible to 
guarantee that cyclic conflicts will be avoided. But before we coiusider our approaches to cyclic 
conflict resolution, we must first be able to identify cyclic conflicts. 


3.3 Cyclic Conflicts and Behaviour Graphs 

A digraph G is a graph consisting of a set V of points and a set E of ordered pairs of distinct 
points. Any such pair is called an arc or a directed line and will be denoted by uv. A walk 
of the graph G is an alternating sequence of points and lines, where each line is incident with the 
two points immediately preceding and following it and the first and the last entry are points. A 
walk joining 0% and j3n may be denoted by /3i : ... : /3„. A closed walk has the same first and last 
points. 

Each behaviour module can be represented by a node in the graph and a directed edge between 
two nodes represents the temporal sequence and the fact that the consequence of the earlier module 
implies stimulus for the latter module. We see that our graphical representation of behaviour 
modules is a digraph as per the definition stated above. 
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Lemma 1(a). Whenever there is a cyclic conflict, there is a cycle in the temporal graph of 
behaviours. 

Proof A cyclic conflict arises when there exists module /3,- such that its consequence implies 
a stimulus of module jSk that is before /8i or is /Sj itself. In the temporal graph therefore, there 
exists a link from jSj to pkt and also a link, in the normal triggering sequence, from jSfc to /^. Hence 
there is a closed walk in the temporal graph, hence a cycle.D 

Lemma 1(b). Whenever there is a cycle in the temporal graph of behaviours that is not termi- 
nated by a recursive condition, there is a cyclic conflict. 

Proof A link from to pk in the temporal graph of behaviours signifies that ^k is triggerable 
after )?<. This can break because of inherent termination condition (recursive termination). In all 
other cases ^k will be triggered after /Sj. 

Consider the behaviour chain C which is found to have a cycle in its temporal graph. Let 

the walk corresponding to this cycle involve the sequence 0k >0i in the ordering as per the 

chain C. However, since this is a walk, there must be a link coming into 0k from some A whidi 
is the same as 0k or occurs later in the chain i.e. k < i. Since this walk is not terminated recur- 
sively, this means that there is a cyclic conflict in accordance with the definition of cyclic conflict.D 

3.4 Conflict Detection Algorithm 

y 

Kube & Zhang report that detecting cyclic conflicts remains an interesting challenge [33]. Con- 
sider the temporal behaviour sequence shown as a graph (Figure 6 ). The creation of this graphical 
representation is guided by the action sequences in a behaviour. Various cycles Ci, Ca, C 3 , C^, 
C 5 are shown. In case of a cyclic behaviour conflict, either the entire graph or a subgraph of it 
is a cycle. Detecting tycles in a graph is a standard problem. Breadth first search can be used 
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to detect cycles in O (n^). If an old node is revisited in the search, this implies a cycle. Cycles 
can also be detected in powers of the adjacency matrix- the (i,j) entry in equals the number 
of difTerent, directed edge sequences of r edges from the vertex i to vertex j [20]. If not a recursive 
cycle, we can eliminate the cycles using behaviour refinement discussed in Chapter 4- 



Figure 6. Graphical representation of the modules and the cycles in it. 



/ 
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Chapter 4. Behaviour Rcflnomont 

The method suggested by Brooks for avoiding cycles is to manually introduce suppressive or in- 
hibitive links at the time of defining the system. These methods have the advantage that the 
behaviour module itself is not modified. As shown in section 3.2, these links do not always elim- 
inate cycles, since the intervening action may not have negated the stimulus for the offending 
behaviour. Hence the cycle can start again after the higher priority behaviour stops being domi- 
nant. Is there any method where the behaviours themselves can be modified to avoid cycles? We 
find the answer Imre. An approach would be to find a small set of directed etlges whose removal 
will render the given digraph G acyclic. Such a smallest set of edges is called as a minimum feed- 
back arc set [34]. But the edges that are recommended for removal cannot disturb the triggering 
sequence, so only backward edges from jSj to A: < i should be removed. To do this, we need to 
nullify (ci ^ Sk). Let us explore some behaviour modification approaches that would adiieve this. 

In psychology, a concept of behaviour generalization has been discussed which involves stim- 
ulus generalization, situation generalization awl resimnws generalization [36]. However as the 
environment triggers the actions of a behaviour-based robot, we consider stimulus generalization 
and the situation generalization as one and the same. 

Stimulus generalization in the human context has also been discussed [31], for a child aftaid 
of a rabbit as well as the beard of Santa Claus, a generalized stimulus is likely to be any moving 
object that contains a concentration of white hair. But our definition of a behaviour {section 
2.1) may not be same as the semantic meaning of a behaviour iii psychology. We look upon 
stimulus generalization as a means of increasing the power of behaviours, e.g. a robot that picks 
up cans, should also pick up books, this can be expressed by introducing internal disjunctions 
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in the stimulus. Kirsh points out that unless robots can generalize stimuli, they will have to be 
reprogrammed to perform what are essentially the same tasks on slightly different objects. If a 
robot can pick up a soda can, it should be able to pick up a coffee cup [32] . Since different tasks 
can now be done by the same behaviour, this increases usefulness. Thus stimulus generalization is 
one of the objectives of behaviour design. 

However sometimes stimulus may be overgeneralized. This leads to condicts which have to be 
resolved by achieving an adequate level of generalization i.e. by specializing the stimulus. Cyclical 
behaviour in wandering and wall following has been reported by [15]. Stimulus overgeneralviation 
is the cause of cyclic behaviour in all these cases. It also gives insights into designing cycle 
eliminating mechanisms. 

For the behaviour designer, to set the right level of generalization for the stimuli is not an easy 
task. Also when we already have a definition of the stimulus and there is a conflict, we need to 
specialize the stimulus. At the same time, restricting the stimulus too mucli would lead to task 
under-performance. For the can pickup example, the stimulus for pick-up can be modified (along 
with an internal state, memory) so that it picks up only those objects it has not seen before; thus 
iigiTig it you can sip your coffee only once. A separate behaviour e.g. multiple-pick-up is needed 
for drinking coffee. This would be a recursive behaviour with a termination condition when the 

level of coffee is too low. Thus the two new behaviours are specializations of the old behaviour. 

/ 

This is similar to the splitting of original behaviour and the division of goals into once- only goals 
that have to be achieved only once and permanent goals that have to be achieved continuously as 
proposed by [39]. However this leads to increase in the number of behaviour modules and reduces 
the power and flexibility of the behaviour system. 

Whenever there is a cycle in a behaviour chain C = {/3i : ^ : /St : ... : Si ‘ A+i-- • Sn}) 
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there must be a triggering of the kind A : ^k, where k <i. Then both A : A+i and A : At are 
possible here. Our objective is to break the Ai : At link without disturbing the A : A+i or Afcw : At 
triggerings which are essential to the successful execution of the chain. 

• A : Ai+i means (cj =»■ Sj+i) 

• A : Afc means (cj =» sj) 

• Ait-i : Alb means (ct-i =► Si) 

Thus (c,- =>Si+i) must remain true whereas (ci =^ 3 k) must be made false. In stimulus specialization, 
this is achieved by specializing Sk and in response generalization, it is achieved by generalizing c,-. 

4.1 Stimulus Specialization 

Let us consider the conflict in picking up the soda cans, where the freshly deposited can is picked 
up. If we were to add the condition “not-deposited-just-now (x)” to the stimulus predicate for 
pickup, then we would only need a small recency memory (recently dropped can). Thus the stim- 
ulus for pickup becomes more specialized. However, in doing this, one must be careful so as not to 
disturb the rest of the chain, i.e. (cfc_i =^Sk) should still hold but {a =>Sk) must be broken. Clearly 
this will not be possible where (c< =^>Cfc_i), then any changes we make in Sk such that -•(<:<=► at) 
will also result in -i (c*_i =► at). Thus stimulus specialization can be used only if (c,- => Cfc_i) is 
not true. One model for this is to say that thra-e must be a literal 7 such that (ct_i => a* At) hut 
-i(ci =»• SkA'i)' conjunction of all such literals F = (71 A 72 A •••Tm) is called the maximal 
difference between ct—i and Cj. 

Stimulus specialization works only when F 96 $. Here a* is modified to (a* At). 7 S F. It is 
advisable not to specialize it more than necessary (e.g. by adding more than one literal), since this 
adve^ly affects the power of the behaviour. A simpler understanding of the process is obtained 
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if both Cj and ct^i are in conjunctive form. Then F is nothing but the difference (ct.-i — Cj) and 
Sfc is modified by conjunction with one of the literals that is in Cjt—i but not in Cj. Note that since 
the stimulus is specialized, any stimuli that are required by the action are still available to it. 

4.2 Response Generalization 

Here the action is modified so that the consequence of the action is weaker i.e. if the old con- 
sequence was c and the new one is d then (c => d) but -i(c^ =► c). If c is in coryunctive form, 
then this implies a reduced length, e.g. we can modify the action of the module drop so that 
while dropping the can on the ground the robot puts it in an inverted position which prevents the 
robot from detecting that the object is a can. The original consequence was (visibU(x) /\ can(x) 
y\ graapable(x)) and the modified consequence is (vi 3 ible(x) /\ graspable(x)). If we decide to 
modify the consequence by covering the can by something to make the predicate ca 7 i(x) false, 
then this leads to addition of a new behaviour module or modifying the action part of the original 
module, both of which require considerable re-programming, and are expensive. In response gen- 
eralization, -1 (sj+i =» Sfc). One way of modeling this would be to say that there must exist a s.t. 
(C{ V O') =► Oi+i -> (Ci V O') The disjunction of all such cr’s is S. 

Again, if Sk and Si+i are in conjunctive form; then a simpler understanding is obtained, since 
S (a* - Si+i) i.e. the negation of all the conjunctions that appear in a* and not in Si+j. 
This negation is a disjunction of many negative literals (~ 7)- 1 “ this instance, modifying Cj to 
(ci V o), where a may be the negation of a literal 7 already appearing in cj, is understood better as 
(Ci -7). Since stimuli/consequences are often conjunctive, this difference notion is a useful concept 

in practice. Thus Cj is modified to (cj — 7), where 7 € (a*, — aj+i). 

Stimulus specialization is easier to do than response generalization, as response generalization 
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requires that the action should be modified. However, stimulus specialization may not always be 
possible; e.g. with “not-deposited-just-now(x)" the robot may still pick up an older deposited 
can. Better solutions to this, such as “nevet^deposited-before(x)” or “not-at-depoaitoty(x)” would 
require considerable global memory. Therefore, stimulus specialization, while cheaper to imple- 
ment, may not be available in many instances, since the actions require a minimum stimulus, and 
specializing it without memory may be counter-productive. 

Summary : 

• Stimulus Specialization : 

When -1 (cj ct—i). 

What : Sk < — (a* A 7 ). 7 € T 
Result : (cj =» Sj+i) but -i (cj =» st). 

• Response Generalization : 

When -I (sj+i =» sj,). 

what : Cj < — (q - 7)1 7 S (a* - aj+i) 

Result : (ci =» a<+i) but -■(<::<=► at). 

4.3 EflFects Of Behaviour Refinement 

Let us now investigate the effects of stimulus specialization and response generalization. 

/ 

Lemma 2. Removing a cycle from chain Cby stimulus specialization or response generalization 
cannot introduce a cycle in any other chain C, that did not have a cycle before. 

Proof :-Let 0k be the behaviour that was specialized. Now to introduce cycles when no cycles 
existed before, some link 0' : 0k must have become possible. This means means (o' Sk) has 
become true now. This is not possible since c-' is the same and Sk is more specific. Similarly, since 
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Cfc has not been modified, no new links Pk : /?' could have been created, hence no new cycle will be 
initiated in any other chain C. Similarly it can be shown that response generalization does not 
introduce new cycles.D 

What is the effect of these cycle elimination strategies on power, effectiveness of the behaviour 
system? This is discussed here. 

Lemma 3(a) . Whenever a behaviour space is modified to eliminate cyclic conflicts by stimulus 
specialization, its usefulness decreases. 

Proof Let E be the stimulus space and s C E and s is a conjunction of its members. Now let 
s be specialized to s' so that s' C s. Now tasks or subsequent behaviours requiring the predicates 
in (s - s') will no longer be attended by B. Thus we need a new behaviour P' for some s" C s, 
sudi that (s" U s') = s, so that /3 and j9' together serve the stimulus set s which implies that | B j 
increases and the usefulness of B decreases. If the new behaviour is not added, the usefulness 
decreases because of decrease in the greatest fulflllable task space. The notion of this proof can 
be generalized to non-coryunctive stimuli, where also a similar set of unserviced stimuli can be 
found. □ 

Lemma 3(b). Whenever a behaviour space is modified to eliminate cyclic conflicts by response 
generalization, the flexibility and usefulness of the behaviour space decreases. 

Proof If the response of P is generalized so that d Dc. Thus (c-c") is not being performed by 

/ 

P. Hence other new behaviours are needed to complete the tasks requiring (c - d) which increases 
I B |. This implies that the usefulness of B decreases. Also addition of new modules increases the 
lengths of the chains composed to fulfill these tasks resulting in decrease in flexibility. If this not 
done then some tasks requiring (c - d) cannot be performed which implies that | t' | < 1 t | which 
again means that the usefulness of the behaviour space decreases. The notion of this proof can be 
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generalized to non-conjunctive consequences, where also a similar set of unserviced stimuli can be 
found.n 

Let us say that we have a behaviour P whose consequence c = p /\ q leads to a cycle. If we use 
response generalization, we may have to design two behaviours /S' and /3" such that d = q and 
d' = p. If has a stimulus a = p \J q which is triggered leading to a cycle and if we use stimulus 
specialization, we may have to design two more behaviours and /3" such that s' = p and s" = 
q. In any case, the number of behaviours goes up and lengtlis of behaviour chains will increase. 
We see that this leads to behaviour splitting. In some cases, especially for response generalization, 
it may not be possible to design an action sudi that it will fulfill these conditions. 

We observe here that both stimulus specialization and response generalization cause reduction 
in the power of the behaviour. This brings us to our most important results, which have to do 
with the power and usefulness of behaviour spaces. 

Behaviour Modification Theorem. Given two behaviour spaces B and B' such that B is more 
powerful than B' (i.e. B' can be obtained from B by replacing some behaviours /? of B by the less 
powerful ones j3') then: 

(a) The greatest fulfillable task space for behaviour space B' is less than that for B i.e. 

\rc{B') l<lrG(B)l 

(b) Usefulness of B is greater than that of B i.e. * |g| 

(c) Probability of a cycle is also greater in B. 

Proof (a) First, let us consider the case where a single behaviour has been replaced by the 
less powerful jS'. The set of chains of behaviours composable from a behaviour space represents 
a tt» »lth mitid point corresponding to th. .vdlnbilily of the right initial «imnlnn «.d eind, 
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o<ic in llils tcpresnnls • 'O™!””'* 

,lliU.bte tnsk npann in proporUon.1 » the total size ot this tree of behaeiour chaine. Now, either 
he behavionr fl will have more applicability due to smaller stimulua length .a compered to the 
rehavionr (f or the behaviour P will Uve stronger consequences resulting in more behaviours being 
.riggerable. In tcrnw of tl« talk tree, eltlmr P will have more pment nodes, or it wiU have more 
d,ildren. In either case, the branching t«:tor is higher in B than in ? mtd the rn» of the task 
im m, large or larger. Since |B| has not dmng^l, the urwlnlnes, ot the behaviour epwre, 
isrga has d.wrea.e.1 . This treatnKmt can be extended to multiple instances ot replacing a strong 

behaviour i>y a 'Mv.hk one.O 

Proo/ (,) Since IP is obtained from B by replacing some. behaviours, | B H B' (. tom (a), 
the restilt follows.O 

P„„/ W .- Ut B. e B and t? . be two behaviours s.t. A is P-“ ^ 

or is weaker than »i. Now consider chain conrposabie in B and B' ot n moduim, 
which dffler only in that tiw module A b repl^ by Now condder .11 behaviours P,eC.,>.. 
with consequerme cy. The probabiUty of a cycle prob-cpcie (B) is 


n 

^prob(c;' Si) 

izi 


i 

1 


and prob- cycle (B') is 


n 

y^ prob(cj Si) 


, ''r > orobtc- >k «1>. Slmllmly 

. Clearly, since W <• Wl>m<d.(ci =» »i) i 

u w out Thus prob-epcie (S) 2 prob-eycU (S)- ° 

analysis can be earned . , h^spacere.but 3(B ®) ABCB' €B') 

Corollnry =-.f B and S' have the smne greatmt fulfUldrle tas 





30 


single bdi}ivi«»nr bv 

If tlwr in ( ' 

powerful limn ./■ Heju-e 
is greater in < ' tlmn in < 
between nn*l ^ bi 


I lwii nil residurils in the two chains are also identical except jFJj-i and 
,-ire si.r*»itger, then (7, => %') and (cr- _i i-e. behaviour ^ is more 

l»y j>arl (f ) nf the beluvviotir modification theorem, probability of a cycle 
", The siitin; argtinients can be extended for multiple behaviour chants 
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Cthnpti r .■». Ktiiiilanttcs with AI Planning 


In thi.s p.Hi» r wr- h.iv.- I.» ux^ .i .,n i},,- n.mparal rdations between behaviours as opposed to the 
control r<>hui..ti<. 1 hi.- U.k< an imporliinl similarity between behaviour-based modeling 

and the . b^v^iro! mtoirl:. ..f piai.t.iuK in Al, I he drecl of actions, wliicli become new stimuli is 
siiniiar i<» tin- pir ti uniiiii.iii jne ujniiHoii Ninicture in means ends planners such as STRUTS (22). 
IikIwsI the iju *l(«'|wr. 


liicriw hi« i»l planurr- a iurjar< ii> of representations of a plan in which the highest is 

a simplifii nlioit at ale irai fnoi of the pinii and the low<*sl is a <letailed plan stifficient to solve the 
probletn. The upproiu b uf a»iv;iiijn; « ritioility l«i the precontlitions of the operators in planning is 
simitar to Mippri-v it»h whi* li j»rit»ritiM^ ludiaviours. NOAil itstss critics or meta-level reasoners. In 
Arkin's behavioiir nmdel blj, a hieror* h« ,il planner is used that first chooses appropriate behaviours 
In miiitinive the likelilooti! i«f tii < in rets e of iocai niiitiina ami Itaoil maxima tiiat cause liicschcma- 
basi'd iiaviy;.'ition.‘ii iueth•)<ioiM^i(^* to fail. This is siiniiar to the mcta-ievel reasoners adopted to 
avoid eittdliftN in plaitnint; Ih-lle.sive planning, iocal pianning, iim]>-based planning and mission 
planning an* ii-'i*'*! for navigation of a rtswi vehicle {15). Unt purists would not consider these to be 
Iruely reactive heliavioiir .systems. 

A famous example of citiillu't.s in Al planning is the stacker problem discussed in HACKER, 
a cotninttationai motlel of skill ac«jni.siti«tn of Sttssinan |45)]. 'PIkmc conflicts are similar to cyclic 
contlict.H ill iH'havionr iiioilels. Ilowtfver, larhaviotir models differ from planning in some crudal 
B.s{)ecl.s. laarality of iM’haviom prograininlng makes opjmrtunistlc plan-generation automatic, since 
tiitt relevant behavitnir i.s triggereti atiittinalit^ally wlteu stiniulus liecomcs very strong. Also, cycles 
we much more of a protdem in l»eh.aviour models since unlike planners, a behaviour does not 
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“switch-ofr-aml-dic" after excctttion; if the stimulus reappears, it may re-cxecute, causing a cycle. 
Finally, in planning, it Is easier to provide for a meta-level reasoning system that resolves conflicts. 


/ 
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Chapter 6. Alternate Architcctureti 

Other sohitjoiis for conflict resolution suggest centralized mediation [50], or use of globd knowledge 
[2] which are not in the ino<ltjlar para<iigin. Use of real time deadline to detect cyclic behaviour 
has also stiggestetl (d) but for a purely reactive agent setting such a deadline is not possible. 
In particular, it would be impossible to distinguish terminating loops from true cycles. Introduc- 
tion of new behaviotirs (18| or general emergency behaviours [27] has also been suggested. In this 
chapter we tliscuss alternate architectures of autonomous robots and show how they axe not car 
pahle of eliminating cyclic conflicts because cyclic conflics are conflicts occuring at the knowledge 
level, anti not at the representation level. Hence, they are not tis easy to detect as extraneous 
behaviour conflicts. Cycles do not occur at the reprsentation level and hence are harder to solve 
there. Different architectures differ in their mechanisms for resolving extraneous resource sharing 
conflicts; however resolving cyclic conflicts has been a difficult problem. 


6.1 Potential Fields 

Tlie representation of boliavloure eaed, mth the first order predleate csiculus notation for stimulus 
aird consoquonoo, makes for s blimry world and cannot model the notion of "alrenirtb o/ .Mmol™- 
much disoussed In modola of behaviour iu psychology. Eodt modulo merely does Its thing ss best 
«, It can (U). However with binary stimuli there is a limit to how wdl a modulo cm. do. fbr 
onaniple. Skinnot-s law of threshold stales that to elicit a response, the Intendty of the stimulus 
must mtceed some threshold. According to Skinner’s law of magnitude, the magnitude of the rw 
spouse is a function of the intensity of the stimulus. Both those notions cannot ho mxmmodatod 


in predicate- based models. 
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T!i« fk.|<l ha«.<i iMilmviour model of Arkii. [3] [4] {5j and Aiulcrsoi. & IJoimtl. [1], is 

tlic closest to the “contirmum stiinuhis" model of the psychologist. Here it is easy to model the 
MtT.ngth of Mimutusi the stronger the potential field gradient, the faster you run; if less fuel Is 
left, Hs«! shorter paths, going closer to obstacle boundaries. One of the properties of the potential 
fields is that of .superixwition, wliich provides a convenient mechanism for combining the output 
from mtdtiple behaviours which may operate concurrently. However, in its current form this model 
docs not have the locality property. Some of the behaviour models are not purely reactive since 
the internal state of robot (fuel, temperature etc.)is taken into account in adaptation. While 
this i.s an important step in making the robot more adaptive, the potential fields model sulfers 
from local minima and cyclic behaviour. Also, potential fields are limited to spatial tasks and 
cannot be adapted to reasoning at more abstract levels. However removal of cycles in continuum 
motlcls causes a lesser decrease in power, usefulness and flexibility as compared to predicate models. 

6.2 Fuzzy Logic 

Tliere is a dichotomy between potential fleld models, which are used almost exclusively in spatial 
path planning, and the predicate logic models which are used in reasoning, and do not ordinarily 
admit of grey levels. One approach for making the predicate models more flexible would be to use 
fuzzy logic; fuzzy stimuli to some extent realize the notion of strength of stimulus. For example, 
consider any predicate, say graspable(x). There are always situations where its truth or falsehood 
are not very clear. Usually boolean functions use an arbitrarily defined threshold to define it. 
The graspable(x) predicate has many nuances - where is the object CG when you grasp it? Is 
the moment just barely smaller than the maximum exertable moment, or is it much less? This 
would be partitioned into some fuzzy categories such as almost-graspable, barely-graspable etc. 
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fHX.«v f:;»t«:gt>rio.s t !»;» nrsult in a strength of stiinuhis measure. 

Fuz/.y logir h.-w bt-cn u.s<;<l to tlefinc fuzzy control functions, where both the stimulus and the 
ron.H<iq»»'iK:« are i!Xpr<ss«:<l fuzzy sets (6) {30] [44]. If-tlien rules are established using these fuzzy 
ronwjpts. 'riit; rolwit has a knowledge base consisting of these rules, which may be thought of as 
ihdining a b<;l»ivio«r nioduic. One stich robot [44] jxjrfonncd quite well iij the AAAI-93 robot 
ronipetition, in the office rearrangement task which involved obstacle avoidance and goal seeking 
Ix'haviour. However, changing the representation to fuzzy models will not eliminate cycles, and 
in<ie<*<l the .search space for detecting cycles may be larger. 

6.3 Conncctionist Architectures 

Hehaviour modules can also be modeled as conncctionist networks of input-output nodes. These 
are stnicttirally close to the biological and psychological models. Often a combination of specific 
stimuli are found to evoke a certain response. What is important is not that all the stimuli are 
present, but that some weighted sum of the stimuli is greater than some threshold value. 

Maes proposes an action selection theory which allows arbitration among goals and actions 
based on inhibitiory and excitatory connections between the actions that a module can perform 
[37]. Cyclic wnflicts are reported in this architecture too. There is no description of the past 
“search”, i.e. no “memory" of past states neither locally, nor globally, as a consequence the same 

/ 

planning mistake can be made over and over again. Maes [37] proposes a very simple solution of 
introducing some randomness in the system or using a second network to monitor possible loops or 
deadlocks in the first network, which is similar to a meta-level reasoner. But this randomness may 
be a temporary solution. A connectionist architecture to simultaneously satisfy the constraints of 
multiple independent behaviours has been proposed where a winner-take-all network can select the 
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most Hcliv;U.«'»l uiiit, for dccKiiijg turn coininands to the veliicJe [46]. 


6.4 Iiyi>rt<j| Systcin:* 

Hybrid .sy.stenw offer a compromise by employing a reactive system for low-level control and a 
planner for iiiglier level <i<x;isiori making. Payton [45] builds a hierarchy of control in which lower 
level niodiiies p<!rform tasks rcrptiriiig greatest immediacy while higher level modules perform tasks 
involving grcat<!r assimilation of sensor data. Cycles can be avoided in these hybrid systems be- 
eamse of use of mcta-knowletige. instead of separating the reactive and traditional planning parts 
of the control system, a fully integrated reactive system is presented by [40] which allows internal 
r<!pr<!S(!iilation.H. 

6.5 Mota Rules 

Meta rules arc used In expert systems for resolving conflicts between rules that can be fired. One 
example is refraction: once a rule has fired, it may not fire again until the elements that match 
its conditions have been modified, or specificity: a more specific rule is preferred to a general rule 
[35], Some more strategies are discussed [16]. In the domain of behaviour-based robotics the use of 
meta-levei reasoners or hierarchical planners to avoid conflicts has been proposed, failure handlers 
and local planning modules selecting sets of behaviours that are appropriate for different situations 

/ 

and goals are used [45], but this violates the modularity assumption. As Kirsh has argued, tasks 
requiring knowledge that can be obtained by reasoning rather than perception cannot be done in 
behaviour- based robotics without representation [32]. 

How would metarrules be used to avoid cyclic conflicts? For example, one could define a metar 
rule that looks for repetitive rule applications for detecting cycles. More specific meta-rules, e.g. 




in t.h(’ rnti rNaiiiplo, would contain the inrormalioii that the goal lias to be achieved only 
our<f for a given Mxia can. However this would recjuire us to track each can leading to inelBcicncy. 
However lueta-nihrs arc more <lif{iciilt to design for reactive systems since the stimulus cannot be 
known heforehaini, and ail behaviours are always active. Another problem is that metarrules can 
l«! {juite eoinplex, an<l »u) in knowlo<ig<>basc<l systems, may result in coiiillcls of their own. 

6.6 {..earning and Behaviour Modification 

An importiUit diffwmee Ixitween robot behavioura and psydiological models is the capacity to 
learn. One model for motw learning in humans is tlic schema model; licrc initial conditions, re- 
sponse s{)ecifica.tions, sensory data and response outcome are stored after each movement. The 
strength of relationship among them and the accuracy increases with each successive movement. 
The learning stage uses feedback from the environment and is therefore a closed-loop. On the other 
hand, the models of (9) and (2] are open loop in which improvements can only be programmed by 
the behaviour designer. 

In biological models of behaviour also, there are some behaviours that are genetically pro- 
grammed (innate), and some that are learned (conditioned). Innate behaviours give an animal, 
an initial repertory of survival tools, but behaviour conditioning allows it to adapt to liexible en- 
vironmental conditions. Current robotic models of behaviour represent only the innate aspects. 
Recent models of behaviour are beginning a discussion on learning: e.g. claiming that adaptation 
takes place only in the mind of the designer in the current approaches to behaviour-based robotics, 
ideas from ethology, machine learning and behaviour-based robotics are combined to propose a 
genetics-based learning architecture for an autonomous agent [21]. An algorithm that allows a 
behaviour-based robot to learn when to activate its behaviours (only conjunctive structures) on 
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iIm; Iwusis Ilf jKisUivir ami lu-jiiilivo fowllmck has been proposal [38]. Others use a three level hier- 
archy (kiiowleilKe level, (xtreeptuo- motor level and sensori-actuator level) to filter out abstractions 

m- 

Often tiie relative importance of goals will be context dependent. However pure perception 
cannot iilentify context, and this is |>oorly handled in purely reactive architectures. On one occa- 
.sion, movement of the hand may be one without intention whereas on an other occasion it may 
be indicative of a goodbye [32|. This brings us to the role of mil, of which intention is a weak 
ver.si(»n. AniinHl.s have the ca|>aclty of evaluating consequences of tlieir actions, and those with 
pleasing consetpicnces are repeated, resulting in conditioning. The question of will raises deep 
philosophical issues, the threshold of which AI is yet to cross. However, defining self-modifying 
reactive systems will certainly call for some model of intention or motivation, which will constitute 
I>art of the internal state of the robot. How this will affect behaviours, and how it can affect the 
incidence of cycles as a meta-level mediator is one of the major researcli directions for behaviour 


systems. 




Chapter 7. Conclusion 


'riic inoiic! in litis |>a|K?r reflects the most serious type of conflict in behaviour systems 

in the form of an infinite teinfmrai cycle in tfie temporal execution of behaviour modules. A simple 
t«*8t i.s provided to det«5ct. .sticlt cycles, so that d&signers will not have nasty surprises awaiting them 
after implementation. We .show that approaches such as prioritization will not avoid cycles. 

'!*he key contribution of this work is to highlight an important limitation of the behaviour- 
baseti roitolics approach. Cycles in the behaviour chains challenge the assumption regarding the 
nuxiuhirity of behaviours which is fundamental to the basic advantages of behaviour-based models. 

Strategies have been identifictl to detect and eliminate such cyclic conflicts in robot behaviour 
scsiucnccvs, 'I’hesc Invtdve behaviour retlesign, and can use citlier rcsix)nse geueralizatioii, or stimu- 
hjs specialization. This leads to an important conclusion regarding behaviour-based models, since 
the less genera! the stimulus, the less useful is the behaviour in the general context. Similarly, the 
more general the consequence of an action, the less constraining the effect i.e. less has been achieved 
by the behaviour. Both these clianges add costs and inflexibility to the behaviour structure. 

The principal insight to be gained from this discussion is that in behaviour design, there is a 
tradeoff between the power of a behaviour and the likelihood of cycles. The crucial task of the 
behaviour designer is to achieve just the right amount of refinement, without involving conflicts 
and without sacrificing too much flexibility. To what extent is this possible? Is there a limit on the 
complexity of tasks that can be performed without any central representation? How can meta-level 
mediators avoul conflicts? What is the role of learning aiul internal statef Some nsscarchers (e.g. 
[23]), feel that internal state can be used to avoid endless futile loops. We feel that using internal 
state would not, in itself be able to remove this type of conflict, although it would make it easier to 
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ttKxlirv tlx' tM'tiavioiiis so llial llto conilicl cnii lx; nvoidod. Another issue rolnlcd to iuloniul stale 

is tlir of tiu? rol>ol (jisychologists read luill). Knowing the intention at some metarlevel, 

* 

it may possibh* to construct tests for detecting conflicts, and even possibly of avoiding them. 
At the .sajm? time, imxiels involving will or intention (as in Searle) are one of the most debated 
and «lii!i«:«H <|uagmir<!s in Ai to<lay. A deeper question raised by the pixjsence of sucli cycles in 
l«‘hHvii>ur'ha.si?<l robotics, a-s well as in other brandies of AJ, is that of its signiflcance to the entire 
.s<!ar< h for artilicial intelligence. Is there some bound on the complexity of any system daiming 
intidiigence, liefore it begins to develop cyclic conflicts? These are but some of the questions raised 
by this research aiui the answers are sure to affect the future of the behaviour-based robot modeling 
paradigm in particular and that of representatiohless models of intelligence in general. 
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